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Abstract 

In  this  paper,  we  provide  tools  for  convergence  and  performance  analysis  of  an  agreement 
protocol  for  a  network  of  integrator  agents  with  directed  information  flow.  Moreover,  we  an¬ 
alyze  algorithmic  robustness  of  this  consensus  protocol  for  the  case  of  a  network  with  mobile 
nodes  and  switching  topology.  We  establish  a  connection  between  the  Fiedler  eigenvalue  of 
the  graph  Laplacian  and  the  performance  of  this  agreement  protocol.  We  demostrate  that  a 
class  of  directed  graphs,  called  balanced  graphs,  have  a  crucial  role  in  solving  average-consensus 
problems.  Based  on  the  properties  of  balanced  graphs,  a  group  disagreement  function  (i.e.  Lya¬ 
punov  function)  is  proposed  for  convergence  analysis  of  this  agreement  protocol  for  networks 
with  directed  graphs.  This  group  disagreement  function  is  later  used  for  convergence  analysis 
for  the  agreement  problem  in  networks  with  switching  topology.  We  provide  simulation  results 
that  are  consistent  with  our  theoretical  results  and  demonstrate  the  effectiveness  of  the  proposed 
analytical  tools. 


1  Introduction 

Distributed  decision-making  for  coordination  of  networks  of  dynamic  agents  has  attracted  several 
researchers  in  recent  years.  This  is  partly  due  to  broad  application  of  multi- agent  system  is  many 
areas  including  cooperative  control  of  unmanned  air  vehicles  (UAVs),  flocking  of  birds  [16,  18,  17], 
schooling  for  underwater  vehicles,  distributed  sensory  networks,  attitude  alignment  of  clusters  of 
satellites,  and  congestion  control  in  communication  networks  [15]. 

Agreement  problems  have  a  long  history  in  the  field  of  computer  science,  particularly  in  au¬ 
tomata  theory  and  distributed  computation  [12].  In  many  applications  involving  multi-agent /multi¬ 
vehicle  systems,  groups  of  agents  need  to  agree  upon  certain  quantities  of  interest.  Such  quantities 
might  or  might  not  be  related  to  the  motion  of  the  individual  agents.  As  a  result,  it  is  important 
to  address  agreement  problems  in  their  general  form  (as  far  as  the  inter-agent  communication  is 
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concerned)  for  networks  of  dynamic  agents  with  directed  information  flow  under  link  failure  and 
creation  (i.e.  variable  network  topology). 

Our  main  contribution  in  this  paper  is  to  provide  convergence,  performance,  and  robustness 
analysis  of  an  agreement  protocol  for  a  network  of  integrator  agents  with  directed  information  flow 
and  (perhaps)  switching  topology. 

In  the  past,  a  number  of  researchers  have  worked  in  problems  that  are  essentially  different  forms 
of  agreement  problems  with  differences  regarding  the  types  of  agent  dynamics,  the  properties  of  the 
graphs,  and  the  names  of  the  tasks  of  interest.  In  [19,  5,  4],  graph  Laplacians  are  used  for  the  task 
of  formation  stabilization  for  groups  of  agents  with  linear  dynamics.  The  drawbacks  of  a  pure  linear 
approach  to  formation  stabilization  can  be  summarized  as  follows:  i)  collision- avoidance  cannot  be 
directly  taken  into  account  (or  be  formulated  as  part  of  the  problem),  ii)  performing  the  rotation 
of  a  formation  cannot  be  addressed,  and  iii)  the  method  has  not  yet  been  extended  to  systems  with 
nonlinear  dynamics  that  are  not  feedback  linearizable.  Special  cases  of  this  approach  are  known  as 
leader-follower  type  architectures  and  have  been  widely  used  by  numerous  researchers  [13,  2,  11]. 
In  [18,  17],  flocking  and  self-alignment  is  analyzed  from  the  point  of  view  of  statistical  mechanics 
and  a  phase  transition  phenomenon  is  observed  that  is  equivalent  to  connectivity  of  graphs.  The 
work  in  [10]  focuses  on  attitude  alignment  for  undirected  dynamic  graphs  in  which  the  agents  have 
simple  dynamics  motivated  by  the  model  used  in  [18].  It  is  claimed  that  the  connectivity  of  the 
graph  on  average  is  sufficient  for  convergence  of  the  heading  angles  of  the  agents.  In  [14],  the 
authors  addressed  convergence  of  linear  and  nonlinear  protocols  for  networks  with  undirected  links 
in  presence  or  lack  of  communication  time-delays.  Theoretically,  the  linear  case  of  agreement  in 
an  undirected  network  without  time-delay  is  much  easier  than  the  analysis  for  the  case  of  directed 
graphs  in  the  present  paper. 

In  this  paper,  we  provide  convergence  analysis  of  an  agreement  protocol  for  a  network  of  in¬ 
tegrators  with  a  directed  information  flow  and  fixed  or  switching  topology.  Our  analysis  relies  on 
several  tools  from  algebraic  graph  theory  [1,  8]  and  matrix  theory  [9].  We  establish  a  connection 
between  the  performance  of  this  consensus  protocol  and  the  Fiedler  eigenvalue  of  graph  Laplacian 
which  is  also  known  as  the  algebraic  connectivity  of  the  graph.  It  turns  out  that  a  class  of  directed 
graphs  called  balanced  graphs  have  a  crucial  role  in  derivation  of  an  invariant  quantity  and  a  Lya¬ 
punov  function  for  convergence  analysis  of  average-consensus  problems  on  directed  graphs.  This 
Lyapunov  function  is  a  measure  of  group  disagreement  in  the  network.  We  show  that  a  directed 
graph  solves  the  average-consensus  problem  using  protocol  A  if  and  only  if  it  is  balanced.  Further¬ 
more,  we  use  properties  of  balanced  networks  to  analyze  the  convergence  of  an  agreement  protocol 
for  networks  with  switching  topology.  This  variation  of  the  network  topology  is  usually  due  to  link 
failures  or  creations  in  networks  with  mobile  nodes.  We  introduce  a  common  Lyapunov  function 
that  guarantees  asymptotic  convergence  to  a  consensus  in  a  network  with  switching  information 
flow.  We  provide  simulation  results  that  demonstrate  our  theoretical  predictions  and  show  the 
novel  analytical  tools  that  we  propose  are  effective. 

An  outline  of  this  paper  is  as  follows.  In  Section  2,  we  provide  some  background  on  algebraic 
graph  theory.  In  Section  3,  we  present  the  setup  for  agreement  problems  in  directed  networks  with 
fixed  or  switching  topology.  In  Section  4,  we  state  some  useful  results  in  matrix  theory  that  are  later 
used  in  this  paper.  Our  main  results  are  given  in  separate  subsections  of  Section  5.  In  Section  6,  the 
simulation  results  are  presented,  for  agreement  on  four  digraphs  and  average-consensus  problem  for 
a  network  with  switching  information  flow.  Finally,  in  Section  7,  we  make  our  concluding  remarks. 
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2  Preliminaries:  Algebraic  Graph  Theory 


In  this  section,  we  introduce  some  basic  concepts  and  notation  in  graph  theory  that  will  be  used 
throughout  the  paper.  More  information  is  available  in  [8,  3]. 

Let  G  =  (V,  £,  A)  be  a  weighted  directed  graph  (or  digraph)  with  n  nodes  and  a  weighted 
adjacency  matrix  A  =  [a^]  where  >  0  for  all  i,  j  €  T  =  {1,2,...,  77.}  :  i  A  j  and  an  =  0  for  all 
i  €  X.  The  set  of  neighbors  of  the  node  'ty  is  denoted  by  W  and  defined  as  Ni  =  {j  G  X  :  atj  >  0}. 
The  in-degree  and  out-degree  of  node  u*  are,  respectively,  defined  as  follows: 

n  n 

degin(ui)  =  degout{vi)  =  ^air  (1) 

3= 1  3= 1 

For  an  ordinary  graph  with  M  that  has  binary  elements  degout(uj)  =  |lVj|.  The  degree  matrix  of  G 
is  a  diagonal  matrix  denoted  by  A  =  [A,j]  where  A ^  =  0  for  all  i  /  j  and  A*j  =  degouf(uj).  The 
(weighted)  graph  Laplacian  matrix  associated  with  G  is  defined  as 

L  =  £{G)  =  A  -  A.  (2) 

With  a  slight  misuse  of  notation,  we  use  C(G)  =  C(A)  to  denote  the  Laplacian  of  graph  G.  By 
definition,  the  graph  Laplacian  has  an  eigenvector  at  Ai  =  0  and  a  right  eigenvector  wr  =  1  = 
(1,1,...,  1)T  with  identical  nonzero  elements.  Furthermore,  for  a  strongly  connected  digraph  G  of 
order  n,  the  Laplacian  matrix  satisfies  the  following  rank  condition: 

rank(L)  =  n  —  1  (3) 

A  digraph  is  called  strongly  connected  if  and  only  if  any  two  distinct  nodes  of  the  graph  can  be 
connected  via  a  path  that  respects  the  orientation  of  the  edges  of  the  digraph. 

Note.  Throughout  this  paper,  we  assume  all  graphs  have  at  least  two  nodes  (i.e.  are  non-trivial) 
and  there  is  no  cycle  of  length  one  (i.e.  an  edge  from  a  node  to  itself). 

For  an  undirected  graph  G,  L  is  symmetric  and  positive  semi-definite.  The  disagreement  function 
(also  referred  to  as  Laplacian  potential)  associated  with  G  is  defined  in  [14]  as  follows 

4>g(x)  =  xTLx  =  -  ^2(xj  -  Xi)2  (4) 

ije£ 

where  xt  denotes  the  value  of  node  V{.  The  value  of  a  node  might  represent  physical  quantities 
including  attitude,  position,  temperature,  voltage,  and  so  on.  We  say  two  distinct  nodes  v%  and  Vj 
agree  if  and  only  if  Xi  =  xj.  Apparently,  =  0  if  and  only  if  all  neighboring  nodes  in  G  agree. 

If  in  addition,  the  graph  is  connected,  then  all  nodes  in  the  graph  agree  and  a  consensus  is  reached. 
Therefore,  &g(x)  is  a  meaningful  function  that  quantifies  the  group  disagreement  in  a  network. 
For  an  undirected  graph  G  that  is  connected  the  following  well-known  property  holds  [8] : 

min  yprur  =  h{L)  (5) 

INI 

lTx  =  0 

The  proof  follows  from  a  special  case  of  Courant-Fischer  Theorem  in  [9] .  We  will  later  establish  a 
connection  between  A2 (L),  called  the  Fiedler  eigenvalue  of  L  [6,  7],  and  the  performance  of  a  linear 
agreement  protocol  where  L  is  closely-related  to  L. 
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3  Agreement  Problem  on  Directed  Graphs 

Consider  a  network  of  integrators 


Xi  =  m,  i  £  X,  Xi,  meR 

with  information  flow  (or  topology)  G  =  (V,£,A). 

Remark  1.  The  main  reason  behind  focusing  on  an  interconected  system  with  nodes  that  have 
extremely  simple  dynamics  is  that  we  would  like  to  discuss  the  main  network  and  communication 
related  aspects  of  agreement  rather  than  addressing  the  conrpelexities  that  arise  from  considering 
agents  with  nonlinear  dynamics  and  possible  input  constraints. 

The  asymptotic  agreement  problem  can  be  described  as  follows.  Give  a  protocol  that  guarantees 
the  state  of  the  network  as  a  whole  asymptotically  converges  to  an  equilibrium  state  x*  £  Mn  with 
identical  elements,  i.e.  x*  =  x*  =:  a  for  all  i,j  £  X,  i  j.  The  element  a  that  determines  x*  is 
called  the  group  decision  value.  An  agreement  problem  in  which  a  =  Ave(x(0))  is  referred  to  as  the 
average- consensus  problem  where  Ave(x)  =  (^"=1  Xj)/n.  Further  information  regarding  a  formal 
definition  of  average-consensus  problem  is  available  in  [14]. 

In  this  paper,  our  goal  is  to  address  convergence  and  performance  issues  of  linear  consensus 
protocols  for  a  network  with  directed  information  flow.  Furthermore,  we  analyze  convergence  of 
the  distributed  agreement  algorithms  for  networks  with  variable  topology ,  or  switching  information 
flow. 

We  focus  on  solving  the  average- consensus  problem  using  the  following  agreement  protocol: 

Mi)  =  ^2  aij(xj(t)  -  xflt )),  i  £  X  (A) 

ieiVi 

In  distributed  average- consensus  problem,  the  objective  of  each  node  of  the  network  is  to  calculate 
the  average  of  the  initial  values  of  all  n  nodes  provided  that  no  node  has  an  edge  with  all  other 
nodes  (unless  n  =  2)  and  the  network  is  connected. 

Given  Protocol  (A),  the  state  of  the  network  evolves  according  to  the  following  linear  system 

x(t)  =  —Lx(t)  (6) 

where  L  =  C{G)  is  the  Laplacian  induced  by  the  information  flow  G.  In  a  network  with  variable 
topology  G.  convergence  analysis  of  Protocol  (A)  is  equivalent  to  stability  analysis  for  a  hybrid 
system 

x(t)  =  -Lkx(t),  k  =  s(t)  (7) 

where  L}.  =  C{Gjf)  is  the  Laplacian  of  G f.,  s(t)  :  I  ->  Ir  C  Z  is  a  switching  signal,  and  F  9  G & 
is  a  finite  collection  of  digraphs  (of  order  n)  with  the  index  set  Xp.  Later,  we  will  see  that  T  is  a 
relatively  large  set  for  n>  1.  The  task  of  stability  analysis  for  the  hybrid  system  in  (7)  is  rather 
challenging  partly  because  q,p  £  Xp ,q  p  most  likely  implies  LqLp  LqLp.  Thus,  rather  simple 
ways  of  constructing  a  common  Lyapunov  function  for  this  switching  system  fail. 
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Spec(-L)  Spec(L) 


Figure  1:  A  demonstration  of  Gersgorin  Theorem  applied  to  graph  Laplacian. 


4  Matrix  Theory  and  Properties  of  Graph  Laplacians 

The  key  in  the  stability  analysis  of  system  (6)  is  in  the  spectral  properties  of  graph  Laplacian.  The 
following  result  follows  from  Gersgorin  disk  theorem  [9]: 

Proposition  1.  (spectral  localization)  Let  G  =  (V,£,A)  be  a  digraph  with  the  Laplacian  L.  Denote 
the  maximum  node  out-degree  of  G  by  6(G)  =  max,;  degout(vt) .  Then,  all  the  eigenvalues  of  L  = 
C(G)  are  located  in  the  following  disk 

D(G)  =  {z  £  C  :  \z  -  6(G)\  <  5(G)}  (8) 

centered  at  z  =  6(G)  +  0 j  in  the  complex  plane  (see  Figure  1).  Moreover,  the  real-part  of  the 
eigenvalues  of  —L  are  non-positive. 

Proof.  Based  on  the  Gersgorin  disk  theorem,  all  the  eigenvalues  of  L  =  [lij\  are  located  in  the 
union  of  the  following  n  disks 


Di  =  {z  G  C  :  \z  -  ln\  <  Y  IMI 


(9) 


But  la  =  A  a  and 

Y  \kj\  =  degout(vi)  =  An 

Thus,  Di  =  {z  £  C  :  \z  —  An\  <  An}.  On  the  other  hand,  all  these  n  disks  are  contained  in 
the  largest  disk  D(G )  with  radius  A (G).  Clearly,  all  the  eigenvalues  of  —L  are  located  in  the 
disk  D'(G )  =  {z  G  C  :  \z  +  6(G) \  <  5(G)}  that  is  the  mirror  image  of  D(G)  with  respect  to  the 
imaginary  axis  and  the  result  follows.  □ 

The  following  result  guarantees  the  convergence  of  Protocol  (A)  for  directed  graphs. 

Proposition  2.  Consider  a  network  of  integrators  with  an  information  flow  G  that  is  a  strongly 
connected  digraph.  Then,  Protocol  (A)  globally  asymptotically  solves  an  agreement  problem,  i.e. 
the  solution  asymptotically  converges  to  an  equilibrium  x*  such  that  x*  =  x*  for  all  i,j,i  j. 

Proof.  Since  G  is  strongly  connected,  rank(L)  =  n  —  1  and  L  has  a  zero  eigenvalue  Ai  =  0  with 
algebraic  multiplicity  of  one.  Based  on  Proposition  1,  the  rest  of  the  eigenvalues  of  L  have  negative 
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2  3 


Figure  2:  A  connected  digraph  of  order  3  that  does  not  solve  the  average-consensus  problem  using 
Protocol  (A). 

real-parts  and  therefore  the  linear  system  in  (6)  is  stable.  On  the  other  hand,  any  equilibrium  x*  of 
(6)  is  a  right  eigenvector  of  L  associated  with  Ai  =  0.  Since  the  eigenspace  associated  with  the  zero 
eigenvalue  is  one-dinrensional,  there  exists  an  a  €  M  such  that  x*  =  a  1,  i.e.  x*  =  x*  =  a,\/i,j.  □ 

Keep  in  mind  that  Proposition  2  does  not  guarantee  whether  the  decision  value  a  of  each  node 
is  equal  to  Ave{x{ 0))  or  not.  In  other  words,  Proposition  2  does  not  address  the  average-consensus 
problem. 

A  sufficient  condition  for  the  decision  value  of  each  node  a  to  be  equal  to  Ave(x( 0)  is  that 
Y^i=iui  =  0-  If  G  is  undirected  (i.e.  at]  =  a,ji  >  0 ,Vz,j  :  /  0),  automatically  the  condition 

Sr=i  Ui  =  holds  and  Ave(x(t))  is  an  invariant  quantity  [14].  However,  this  property  does  not 
hold  for  a  general  digraph. 

A  simple  counterexample  is  a  strongly  connected  digraph  of  order  n  =  3,  shown  in  Figure  2, 
that  is  unweighted  and  has  the  following  sets  of  vertices  and  edges: 

V  =  {1,2,3},£  =  {12,23,31,13}. 

For  the  digraph  G  =  (V,£),  ^i=i  ui  =  x 3  —  x\.  Thus,  if  nodes  1  and  3  disagree,  the  property 
Ui  =  0  does  not  hold  for  all  x.  On  the  other  hand,  the  reader  can  verify  that  for  this  example 

'2  -1  -1  ' 

L  =  0  1-1 

-10  1 

and  x*  =  [x'i (0)  +  #2(0)  +  2x3(0)]/4  (this  is  due  to  Theorem  1).  This  decision  value  is  apparently 
in  the  convex  hull  of  all  the  Xj(0)’s  but  it  is  different  from  Ave(x( 0))  if  and  only  if  xi(0)  +  £2(0)  7^ 
2x3(0).  As  a  result,  for  all  initial  conditions  satisfying  aq(0)  +  ^2(0)  /  2x3(0),  Protocol  (A)  does 
not  solve  the  average-consensus  problem  but  still  all  nodes  reach  an  agreement.  This  motivates  us 
to  characterize  the  class  of  all  digraphs  that  solve  the  average- consensus  problem. 

Before  presenting  our  main  result,  we  need  to  provide  a  limit  theorem  for  exponential  matrices 
of  the  form  exp(— Lt).  This  is  because  the  solution  of  (6)  is  given  by 

x(t)  =  exp(— Lt)x(0)  (10) 

and  by  explicit  calculation  of  exp  (—Lt),  we  can  obtain  the  decision  value  of  each  node  after  reaching 
consensus  for  a  general  digraph.  The  following  theorem  is  closely  related  to  a  famous  limit  theorem 
in  the  theory  of  non-negative  matrices  known  as  Perron-Frobenius  Theorem  [9]  (we  discuss  the 
specifics  of  this  relation  in  an  upcoming  paper). 
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Notation.  Following  the  notation  in  [9],  we  denote  the  set  of  m  x  n  real  matrices  by  Mm  n  and 
the  set  of  square  n  x  n  matrices  by  Mn.  Furthermore,  throughout  this  paper,  the  right  and  left 
eigenvectors  of  the  Laplacian  L  associated  with  Ai  =  0  are  denoted  by  wr  and  wi,  respectively. 

Theorem  1.  Assume  G  is  a  strongly  connected  digraph  with  Laplacian  L  satisfying  Lwr  =  0, 
wf  L  =  0,  and  wfwr  =  1.  Then 

R  =  lim  exp(— Lt)  =  wrwf  G  Mn  (11) 

t— >+oo 


Proof.  Let  A  =  —L  and  let  J  be  the  Jordan  form  associated  with  A,  i.e.  A  =  SJS _1.  We  have 
exp  (At)  =  S'exp(Jt)5_1  and  as  t  — >  +oo,  exp(Ji)  converges  to  a  matrix  Q  =  [qij\  with  a  single 
nonzero  element  gn  =  1.  The  fact  that  other  blocks  in  the  diagonal  of  exp(Jt)  vanish  is  due  to 
the  property  that  Re(Afc(A))  <  0  for  all  k  >  2  where  XjflA)  is  the  kth  largest  eigenvalue  of  A  in 
terms  of  magnitude  |Afc|.  Notice  that  R  =  SQS _1.  Since  AS  =  SJ  the  first  column  of  S  is  wr. 
Similarly,  S'-1  A  =  JS-1  that  means  the  first  row  of  S'-1  is  wf .  Due  to  the  fact  that  S~1  S  =  I, 
wi  satisfies  the  property  wfwr  =  1  as  stated  in  the  question.  A  straightforward  calculation  shows 
that  R  =  wrwj  G  Mn.  □ 

5  Main  Results 

In  this  section,  we  present  three  of  our  main  results:  i)  characterization  of  all  connected  digraphs 
that  solve  average-consensus  problem  using  Protocol  (A),  and  ii)  the  relation  between  the  perfor¬ 
mance  of  Protocol  (A)  and  the  Fiedler  eigenvalue  (i.e.  algebraic  connectivity)  of  graphs,  and  iii) 
robust  agreement  under  switching  information  flows  and  link  failures/creations. 

5.1  Balanced  Graphs  and  Average-Consensus  on  Digraphs 

The  following  class  of  digraphs  turns  out  to  be  instrumental  in  solving  average-consensus  problems: 

Definition  1.  (balanced  graphs)  We  say  the  node  vi  of  a  digraph  G  =  (V,  £,  A)  is  balanced  if  and 
only  if  its  in-degree  and  out-degree  are  equal,  i.e.  deg out(vi)  =  deg in(vj).  A  graph  G  =  (V,£,A)  is 
called  balanced  if  and  only  if  all  of  its  nodes  are  balanced,  i.e.  aji,\/i. 

Example  1.  Any  undirected  graph  is  balanced.  Furthermore,  the  digraphs  shown  in  Figure  3  are 
all  balanced. 

Here  is  our  first  main  result: 

Theorem  2.  Consider  a  network  of  integrators  with  directed  information  flow  G  =  (V,£,A)  that 
is  strongly  connected.  Then,  G  globally  asymptotically  solves  the  average- consensus  problem  using 
Protocol  (A)  if  and  only  if  G  is  balanced. 

Proof.  The  proof  follows  from  Propositions  3  and  4. 

Remark  2.  According  to  Theorem  2,  if  a  graph  is  not  balanced,  then  it  does  not  globally  solve  the 
average  consensus-problem  using  Protocol  (A) .  This  assertion  is  consistent  with  the  counterexample 
given  in  Figure  2. 
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Figure  3:  Three  examples  of  balanced  graphs. 


Proposition  3.  Consider  a  network  of  integrators  with  directed  information  flow  G  =  (V,£,A) 
that  is  strongly  connected.  Then,  the  digraph  G  globally  asymptotically  solves  the  average- consensus 
problem  using  Protocol  (A)  if  and  only  if  1 T L  =  0. 

Proof.  From  Theorem  1,  with  ivr  =  1  we  obtain 

y/n 

x*  =  lim  x(t )  =  Rx o  =  wr(wfx o)  =  —=(wTx o)l. 
t^+oo  Jn 


This  implies  Protocol  1  globally  exponentially  solves  a  consensus  problem  with  the  decision  value 
-^(wfx o)  for  each  node.  If  this  decision  value  is  equal  to  Ave(xo),Vxo  £  Mn,  then  necessarily 

~flnWi  =  flTi'  Wl  =  Wr  =  This  implies  that  1  is  the  left  eigenvector  of  L.  To  prove  the 

converse,  assume  that  1TL  =  0.  Let  us  take  wr  =  ^1,  wi  =  /31  with  ft  £  M,  (3  0.  From  condition 

wfwr  =  1,  we  get  ft  =  ^  and  wi  =  ^1.  This  means  that  the  decision  value  for  every  node  is 
w?x0 )  =  ^Tx0  =  Ave(x  0).  □ 


Corollary  1.  Assume  all  the  conditions  in  Proposition  3  hold.  Suppose  L  has  a  left  eigenvector 
7  =  (7i,...,7n)T  associated  with  A  =  0  that  is  a  nonnegative  vector  in  Mn  (i.e.  a  vector  with 
non-negative  elements)  satisfying  >  0-  Then,  the  decision  value  of  the  group  after  reaching 

consensus  is  given  by 

Ei  7»g»(0) 

Ct  r — -V 

i.e.  the  decision  value  is  in  the  convex  hull  of  initial  values  of  the  nodes. 


Proof.  We  have  7 T L  =  0  and  thus  7 Tu  =  0  (because  u  =  —Lx).  Therefore,  (3  =  7^ x  is  an  invariant 
quantity.  Assume,  the  digraph  G  is  not  balanced.  Then,  still  an  agreement  is  asymptotically 
reached.  Let  a  be  the  decision  value  of  all  nodes  after  reaching  consensus.  We  have  7T.t*  =  7Tx(0) 
due  to  invariance  of  ^Tx{t).  But  x*  =  al,  thus  we  obtain 


a  =  7Tx(0) 


and  the  result  follows.  □ 

The  following  result  shows  that  if  one  of  the  agents  uses  a  relatively  small  update  rate  (or 
step-size),  i.e.  7 3>  7 i  for  all  i  /  i*.  Then,  the  value  of  all  nodes  converges  to  the  value  of  x*.  In 
other  words,  the  agent  i*  plays  the  role  of  a  leader  in  leader- follower  type  architecture. 

Corollary  2.  (multi-rate  integrators)  Consider  a  network  of  multi-rate  integrator  with  the  node 
dynamics 

7 iXi  =  Ui,  7i  >  0,Vi  €  1  (13) 

Assume  each  node  applies  Protocol  (A).  Then,  an  agreement  is  globally  asymptotically  reached  and 
the  decision  value  of  the  group  is 

Ei  7igj(0) 

Li  7; 


Proof.  The  dynamics  of  the  network  evolves  according  to 

Dx  =  —Lx 

where  D  =  diag(y)  is  a  diagonal  matrix  with  the  ith  diagonal  element  that  is  equal  to  7*  >  0.  The 
last  equation  can  be  rewritten  as 

x  =  —Lx 

where  L  =  D~1L  =  diag(l/7i, . . . ,  I/7 n)L  is  a  valid  Laplacian  matrix  for  a  digraph  G  with  adja¬ 
cency  matrix  A  =  D~1A  (i.e.  the  weights  of  the  edges  leaving  node  i  are  divided  by  7*).  Clearly, 
7  is  a  vector  with  positive  elements  that  is  the  left  eigenvector  of  L  and  based  on  Corollary  1  the 
decision  value  is  in  the  weighted  average  of  Xj(0)’s  with  weights  specified  by  7.  □ 

Proposition  4.  Let  G  =  (V,  £ ,  A)  be  a  digraph  with  an  adjacency  matrix  A  =  [atj\  satisfying 
an  =  0,  Vi.  Then,  all  the  following  statements  are  equivalent: 

i)  G  is  balanced, 

ii)  wi  =  1  is  the  left  eigenvector  of  the  Laplacian  of  G  associates  with  the  zero  eigenvalue,  i.e. 
1  tL  =  0. 

Hi)  ELi  ui  =  0,  Vx  G  Mn  with  Ui  =  EjeNi  aij(xj  ~  xi )• 

Proof.  We  show  i)  ii)  and  ii)  Hi). 

Proof  of  i)  ii):  We  have  A**  =  degout(fi)  and  degin(uj)  =  Ej  j^iaji>  thus  the  ith  column 

sum  of  L  is  equal  to 

Iji  =  Iji  +  la  =  —  deg in{vi)  +  degout(vi)  =  0  77  node  Vi  of  G  is  balanced 

i  i,j^i 

Noting  that  the  i  column  sum  of  L  is  the  same  as  the  ith  element  of  the  row  vector  1 T L,  one 
concludes  that  1 T L  =  0  iff  all  the  nodes  of  G  are  balanced,  i.e.  G  is  balanced. 

Proof  of  ii)  in):  Since  u  =  —Lx,  ( Eiui  =  0,Vx)  77  (1  Tu  =  — (1 T L)x  =  0,Vx)  77  1TL  = 

0.  □ 
Remark  3.  Notice  that  in  Proposition  4,  the  graph  G  does  not  need  to  be  connected.  Moreover, 
Proposition  4  holds  for  a  general  digraph  with  an  weighted  adjacency  matrix  that  has  nonzero 
diagonal  elements.  However,  here  we  assume  the  no  trivial  cycles  of  length  one  in  the  graph.  If 
an  A  0)  then  i  £  Nx  and  the  term  an(xi  —  xf)  =  0.  In  other  words,  ut  remains  unchanged. 
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5.2  Performance  of  Group  Agreement  and  the  Mirror  Operation 

In  this  section,  we  discuss  performance  issues  of  Protocol  (A)  with  balanced  graphs.  An  important 
consequence  of  Proposition  4  is  that  for  networks  with  balanced  information  flow,  a  =  Ave(x)  is  an 
invariant  quantity.  This  is  certainly  not  true  for  an  arbitrary  digraph.  The  invariance  of  Ave(x) 
allows  decomposition  of  x  according  to  the  following  equation: 

x  =  al  +  5  (15) 

where  a  =  Ave(x)  and  6  E  Mn  satisfies  JT  Si  =  0.  We  refer  to  <5  as  the  (group)  disagreement 
vector.  The  vector  6  is  orthogonal  to  1  and  belongs  to  an  (n  —  l)-dinrensional  subspace  called  the 
disagreement  eigenspace  of  L  provided  that  G  is  strongly  connected.  Moreover,  6  evolves  according 
to  the  (group)  disagreement  dynamics  given  by 

6  =  -L5.  (16) 


It  turns  out  that  a  useful  property  of  balanced  graphs  is  that  for  any  balanced  digraph  G,  there 
exists  an  undirected  graph  that  has  the  same  disagreement  function  as  G.  In  the  following,  we 
formally  define  this  induced  undirected  graph. 

Definition  2.  (mirror  graph/operation)  Let  G  =  (V,£,A)  be  weighted  digraph.  Let  £  be  the  set 
of  reverse  edges  of  G  obtained  by  reversing  the  order  of  all  the  pairs  in  £.  The  mirror  of  G  denoted 
by  G  =  M(G)  is  an  undirected  graph  in  the  form  G  =  (V,£,  A)  with  the  same  set  of  nodes  as  G, 
the  set  of  edges  £  =  £  U  £,  and  the  symmetric  adjacency  matrix  A  =  [djj]  with  elements 


Ojj  —  a  a  — 


a%j  +  a 


’ji 


ji 


>  0 


(17) 


The  following  result  shows  that  the  operations  of  C  and  Sym  on  a  weighted  adjacency  matrix 
A  commute.  Moreover, 


Theorem  3.  Let  G  be  a  digraph  with  adjacency  matrix  A  =  adj(G)  and  Laplacian  L  =  C(G). 
Then  Ls  =  Sym(L)  =  (L  +  LT)/ 2  is  a  valid  Laplacian  matrix  for  G  =  A4(G)  if  and  only  if  G  is 
balanced,  i.e.  the  following  diagram  commutes  iff  G  is  balanced 


G 


adj 


A 


L 


M 


Sym 


Sym 


G 


adj 


A 


L 


(18) 


Moreover,  if  G  is  balanced,  the  disagreement  functions  of  G  and  G  are  equal. 

Proof.  We  know  that  G  is  balanced  iff  1 T L  =  0.  Since  LI  =  0,  we  have  1 T L  =  0  <^=^ 
+  LT)  1  =  0.  Thus,  G  is  balanced  iff  Ls  has  a  right  eigenvector  of  1  associated  with  A  =  0,  i.e. 
Ls  is  a  valid  Laplacian  matrix.  Now,  we  prove  that  Ls  =  C[G).  For  doing  so,  let  us  calculate  A 
element-wise,  we  get 

A  a  =  —  2  a"  =  \(de&out(vi)  +degin(u*))  =  deg  out(vi)  =  An 

j 
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Thus,  A  =  A.  On  the  other  hand,  we  have 

Ls  =  l-[L  +  Lt)  =  A  -  A+2Al  =  A  -A  =  L  =  C(G) 

The  last  part  simply  follows  from  the  fact  that  L  is  equal  to  the  symmetric  part  of  L  and  xT(L  — 
Lt)x  =  0.  □ 

Notation.  For  simplicity  of  notation,  in  the  context  of  algebraic  graph  theory,  A k(G)  is  used  to 
denote  A k(£(G)). 

Now,  we  are  ready  to  present  our  main  result  on  performance  of  the  Protocol  (A)  in  terms  of 
the  speed  of  reaching  a  consensus  as  a  group. 

Theorem  4.  (performance  of  agreement)  Consider  a  network  of  integrators  with  a  directed  infor¬ 
mation  flow  G  that  is  balanced  and  strongly  connected.  Then,  given  Protocol  (A),  the  following 
statements  hold: 

i)  the  group  disagreement  (vector)  6  as  the  solution  of  the  disagreement  dynamics  in  (16)  globally 
asymptotically  vanishes  with  a  speed  that  is  equal  to  k  =  A2 (G)  (or  the  Fiedler  eigenvalue  of 
the  mirror  graph  of  G),  i.e. 

ITOII  <  11^(0)11  exp(-/rf)>  (19) 

ii)  the  following  smooth,  positive  definite,  and  proper  function 

V(S)  =  i||<5||2  (20) 

is  a  valid  Lyapunov  function  for  the  disagreement  dynamics. 

Proof.  We  have 

V  =  —StL5  =  —5tLs5  =  —5tL5  <  -A2(G)||<5||2  =  -2 kV{6)  <  0,V5  0  (21) 

This  proves  that  V ( 6 )  is  a  valid  Lyapunov  function  for  the  group  disagreement  dynamics.  Moreover, 
5(t )  vanishes  globally  exponentially  fast  with  a  speed  of  k  as  f  — >  +00..  The  fact  that  Ls  =  L  is  a 
valid  Laplacian  matrix  for  an  undirected  graph  (i.e.  mirror  of  G)  follows  from  Theorem  3  and  the 
inequality 

5tL5  >  A2(G')||A||2,  VS  :  1TS  =  0  (22) 

which  is  due  to  equation  (5).  □ 

A  well-known  observation  regarding  the  Fiedler  eigenvalue  of  an  undirected  graph  is  that  for 
dense  graphs  A2  is  relatively  large  and  for  sparse  graphs  A2  is  relatively  small  [8]  (this  is  why  A2  is 
called  the  algebraic  connectivity).  According  to  this  observation,  from  Theorem  4,  one  can  conclude 
that  a  network  with  dense  interconnections  solves  an  agreement  problem  faster  than  a  connected 
but  sparse  network.  This  is  consistent  with  common  sense  regarding  agreement  in  a  group.  As  a 
special  case,  a  cycle  of  length  n  that  creates  a  balanced  digraph  on  n  nodes  solves  an  agreement 
problem.  However,  this  is  a  relatively  slow  way  to  solve  such  a  consensus  problem. 
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5.3  Agreement  in  Networks  with  Switching  Topology 

Consider  a  network  of  mobile  agents  that  communicate  with  each  other  and  need  to  agree  upon 
a  certain  objective  of  interest  or  perform  synchronization.  Since,  the  nodes  of  the  network  are 
moving,  it  is  not  hard  to  imagine  that  some  of  the  existing  communication  links  can  fail  simply  due 
to  the  existence  of  an  obstacle  between  two  agents.  The  opposite  situation  can  arise  where  new 
links  between  nearby  agents  are  craeted  because  the  agents  come  to  an  effective  range  of  detection 
with  respect  to  each  other.  In  other  words,  in  the  graph  G  representing  the  information  flow  of 
the  network,  certain  edges  can  be  added  or  removed  from  G.  Here,  we  are  interested  to  investigate 
that  in  case  of  a  network  with  switching  topology  whether  it  is  still  possible  to  reach  a  consensus  or 
not. 

Consider  a  hybrid  system  with  a  continuous-state  x  £  R"  and  a  discrete-state  G  that  belongs 
to  a  finite  set  of  digraphs 

Tn  =  {G  :  G  is  a  digraph  of  order  n  that  is  strongly  connected  and  balanced} 

that  can  be  analytically  expressed  in  the  form 

Tn  =  {G  =  (V,  S,  A)  :  rank(£(G))  =  n  -  1, 1 T  C(G)  =  0}.  (23) 

Given  the  node  dynamics  and  protocol,  the  continuous-state  of  the  system  evolves  according  to  the 
following  dynamics 

x(t)  =  -C(Gk)x(t),  k  =  s(t),GkeTn  (24) 

where  s(t)  :  R>o  — >  2rn  is  a  switching  signal  and  Try  C  N  is  the  index  set  associated  with  the 
elements  of  Tn.  Clearly,  Tn  is  a  finite  set,  because  either  a  digraph  has  no  edges  or  it  is  a  complete 
graph  with  n(n  —  1)  directed  edges. 

The  key  in  solving  the  agreement  problem  for  mobile  networks  with  switching  topology  is  a 
basic  property  of  the  Lyapunov  function  in  (20)  and  the  properties  of  balanced  graphs.  Note  that 
the  function  V(5)  =  ^||<j||2  does  not  depend  on  G  or  L  =  C(G).  This  property  of  V (6)  makes  it 
an  appropriate  candidate  as  a  common  Lyapunov  function  for  stability  analysis  of  the  switching 
system  (24). 

Theorem  5.  For  any  arbitrary  switching  signal  s(-),  the  solution  of  the  switching  system  (24), 
globally  asymptotically  converges  to  Ave(x( 0))  (i.e.  average- consensus  is  reached).  Moreover,  the 
following  smooth,  positive  definite,  and  proper  function 

=  (25) 

is  a  valid  common  Lyapunov  function  for  the  disagreement  dynamics  given  by 

5(t)  =  -C(Gk)5(t),  k  =  s(t),Gk  £  Tn  (26) 

Furthermore,  the  disagreement  vector  5  vanishes  exponentially  fast  with  the  least  rate  of 

«*  =  min  A2(£(G)))  (27) 

CtEI  n 

In  other  words,  ||<5(t)||  <  ||5(0)  ||  exp(— n*t). 
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Proof.  Due  the  fact  that  Gk  is  balanced  for  all  k  and  u  =  —C(Gk)x,  we  have  1  Tu  =  — (1  T  C(Gk))x  = 
0.  Thus,  a  =  Ave(x)  is  an  invariant  quantity  which  allows  us  to  decompose  x  as  x  =  al  +  6.  There¬ 
fore,  the  disagreement  switching  system  induced  by  (24)  takes  the  form  (26).  Calculating  V,  we 
get 


V  =  -5TC{Gk)5  =  —5TC(Gk)5  <  -A2(£(Gfc))IH|2  <  -k*||<5||2  =  -2 k*V(5)  <  0,V<J  +  0  (28) 

This  guarantees  that  P(<5)  is  a  valid  common  Lyapunov  function  for  the  disagreement  switching 
system  (26).  Moreover,  we  have 

V(5(t))  <  P(5(0))  exp(— 2K*t)  =>•  ||<5(f)||  <  ||5(0)||  exp(— K*t) 

and  the  disagreement  vector  5(t)  globally  exponentially  vanishes  with  a  speed  of  k*  >  0  as  t  — >  +oo. 
Finally,  the  minimum  in  (27)  always  exists  and  is  achieved  because  Tn  is  a  finite  set. 


6  Simulation  Results 


Figure  4  shows  four  different  networks  each  with  n  =  10  nodes  that  are  all  strongly  connected  and 
balanced.  The  weights  associated  with  all  the  edges  are  1.  For  the  following  initial  node  values 
satisfying  y4ue(x(0))  =  0 

x(0)  =  (-10.2999, 0.2575,  -4.4997,  3.6258, 3.0922,  9.0156, 3.5099,  -2.6645, 2.4552,  -4.4921)T 


we  have  plotted  the  state  trajectories  and  the  disagreement  function  ||<5||2  associated  with  these  four 
digraphs  in  Figure  5.  It  is  clear  that  as  the  number  of  the  edges  of  the  graph  increase,  algebraic 
connectivity  (or  A2)  increases,  and  the  settling  time  of  the  trajectory  of  the  node  values  decreases. 
The  case  of  a  directed  cycle  of  length  n  =  10,  or  Ga,  has  the  largest  over-shoot.  In  all  four  cases, 
an  agreement  is  asymptotically  reached  and  the  performance  is  improved  as  a  function  of  A 2(Gfc) 
for  k  G  {a,  b,  c,  d}. 


Figure  4:  For  examples  of  balanced  and  strongly  connected  digraphs:  (a)  Ga,  (b)  Gb,  (c)  Gc  ,  and 
(d)  Gd  satisfying. 
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Algebraic  Connectivity=0.1 91  Algebraic  Connectivity=0.205 


Algebraic  Connectivity=0.213 


Algebraic  Connectivity=0.255 


(c) 


(d) 


Figure  5:  For  examples  of  balanced  and  strongly  connected  digraphs:  (a)  Ga ,  (b)  Gb,  (c)  Gc  ,  and 
(d)  Gd  satisfying. 


In  Figure  6(a),  a  finite-state  machine  is  shown  with  the  set  of  states  {Ga,  Gb,  Gc,  Gd}  represent¬ 
ing  the  discrete-states  of  a  network  with  switching  topology  as  a  hybrid  system.  The  hybrid  system 
starts  at  the  discrete-state  Gb  and  switches  every  T  =  1  second  to  the  next  state  according  to  the 
state  machine  in  Figure  6(a).  The  continuous-time  state  trajectories  and  the  group  disagreement 
(i.e.  ||<5||2)  of  the  network  are  shown  in  Figure  6(b).  Clearly,  the  group  disagreement  is  monotoni- 
cally  decreasing.  One  can  observe  that  an  average-consensus  is  reached  asymptotically.  Moreover, 
the  group  disagreement  vanishes  exponentially  fast. 

7  Conclusion 

In  this  paper,  we  addressed  convergence  and  performance  problems  for  an  agreement  protocol  for  a 
network  of  dynamic  agents  with  integrator  dynamics  and  directed  information  flow.  Moreover,  we 
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Figure  6:  (a)  A  finite-state  machine  with  four  states  representing  the  discrete-states  of  a  network 
with  variable  topology  and  (b)  trajectory  of  the  node  values  and  the  group  disagreement  for  a 
network  with  a  switching  information  flow. 


analyzed  robustness  of  this  consensus  protocol  changes  in  the  topology  of  a  network  with  mobile 
nodes.  We  showed  that  balanced  graphs  are  the  only  type  of  digraphs  that  solve  the  average- 
consensus  problem  with  the  aforementioned  agreement  protocol.  Moreover,  we  proved  that  for  any 
balanced  digraph,  there  exists  an  undirected  graph  called  the  mirror  graph.  This  mirror  graph  has 
the  same  Laplacian  disagreement  function  as  the  original  digraph  and  its  Laplacian  is  the  symmetric 
part  of  the  Laplacian  of  the  network  in  question.  A  commutative  diagram  was  given  that  shows  the 
operations  of  taking  Laplacian  and  symmetric  part  of  a  matrix  commute  for  weighted  adjacency 
matrices  of  balanced  graphs. 

Fiedler  eigenvalue  of  the  mirror  of  a  digraph  is  used  to  quantify  the  speed  of  convergence  of 
the  above  agreement  protocol.  Moreover,  a  simple  disagreement  function  was  introduced  as  a 
Lyapunov  function  for  the  group  disagreement  dynamics.  This  was  later  used  to  provide  a  common 
Lyapunov  function  that  allowed  convergence  analysis  of  an  agreement  protocol  for  a  network  with 
mobile  nodes  and  switching  topology.  We  provided  simulation  results  that  were  consistent  with  our 
theoretical  predictions  and  demonstrated  the  use  of  new  graph  theoretical  tools  and  notions. 
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